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Summary 

The  exact  likelihood  of  the  data  coming  from  a  moving  average  model 
of  order  is  complicated.  In  this  paper,  we  propose  a  method  of  estimation  of 
the  parameters  of  a  moving  average  model  of  order  one  based  on  the  approximate 
likelihood  of  the  data  and  on  the  simulation  of  a  pair  of  random  variables.  Some 
comparisons  were  made  of  this  method  with  some  well  known  methods  for  moderate 
sample  sizes.  A  computer  program  is  appended  which  is  helpful  in  using  this  method. 

I 
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1 .  Introduction 

Estimation  of  parameters  of  a  moving  average  model  is  a  delicate 
subject  fraught  with  complications.  There  are  several  methods  available  in 
the  literature  for  estimating  the  parameters  of  a  moving  average  model.  Many 
of  these  methods  require  an  enormous  amount  of  computational  effort.  Though 
most  of  these  methods  provide  consistent  estimators  of  the  parameters,  it 
is  of  some  interest  to  compare  their  performance  for  moderate  sample  sizes. 
McClave  (1974)  compared  the  performance  of  some  fi/e  methods  of  estimation 
(Durbin  (1959),  Walker  (1961),  Hannan  (1969),  Parzen  and  Clevenson  (1970), 
and  Anderson  (1973))  by  simulating  a  first-order  moving  average  model 

»  e^  +  6e^_j,  t  -  0,  il,  ±2,  ...  , 

where  e^,  t  =  0,  ±1,  ±2,  ...  is  an  independent  identically  distributed 

2 

gaussian  process  with  mean  zero  and  variance  a  =  1,  for  S  =  0.5  and  0.9, 
taking  the  sample  size  N  =  100.  McClave  (1974)  recommends  the  use  of 
Parzen-Clevenson's,  Hannan's  and  Walker's  methods  in  that  order  for  estimation. 
All  these  methods  use  approximations  of  one  kind  or  another  for  the  true 
expressions  involved.  As  a  result,  these  methods  have  inherently  a  certain 


involves  .  The  inverse  of 


can  be 


The  likelihood  of  y^.y^ . y^.  ^ 

determined  exactly  but  the  exact  likelihood  of  y^ ty2f • • • ty^^  is  too  unwieldy 
to  handle.  See  Shaman  (1969).  In  many  of  the  methods  currently  used  in 
estimating  6  of  the  moving  average  model  of  order  one,  is  replaced  by 

a  matrix  whose  inverse  has  a  simple  form.  See  Shaman  (1969),  McClave  (1974), 
Godolphin  (1978)  and  Godolphin  and  de  Gooijer  (1982).  The  replacement  considered 
is  given  by 
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We  call  the  resultant  likelihood  of  yj^  »y2 » •  •  •  t y^j  using  as  "approximate 

likelihood". 


Whittle  (1953)  has  shown  that  the  maximum  likelihood  estimator 
(using  exact  likelihood)  of  6  is  consistent,  efficient  and  asymptotically 
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normal.  (In  all  these  deliberations,  we  assume  that  1b|<  1.)  It  can  be  shown 

that  the  estimator  of  B  obtained  using  the  approximate  likelihood  is 

consistent.  See  Niroomand  Chapeh  and  Bhaskara  Rao  (1987) .  However,  for 

moderate  sample  sizes  the  performance  of  the  estimator  based  on  approximate 

likelihood  does  not  seem  to  be  satisfactory  for  values  of  0  close  to  zero 

and  to  one.  We  have  simulated  the  moving  average  model  of  order  one  for 

2 

S  *  0.1  (0.1)  0.9  and  a  =1  taking  N  =  100,  and  the^  used  the  approximati 

likelihood  to  estimate  0  and  a  .  The  symbols  0  and  indicate  averagei 

2 

of  estimates  of  0  and  o  (  *=1),  respectively,  taken  over  100  repetitions 

A  A  2 

of  the  above  procedure.  The  symbols  var(0)  and  var(o^)  indicate  the 

2 

variances  of  these  100  estimates  of  0  and  a  ,  respectively, 

TABLE  1  :  Mean  and  variances  of  the  estimates  using  approximate  likelihood 


True  Value 
of  0 

A 

8 

var(6) 

"2 

a 

'■2 

var(a  ) 

0.1 

0.086446 

0.013927 

0.972431 

0.021727 

0.2 

0.175466 

0.009216 

1.012012 

0.022227 

0.3 

0.308813 

0.010092 

0.974329 

0.016091 

0.4 

0.403180 

0.008703 

0.979329 

0.017651 

0.5 

0.502262 

0.009645 

0.994639 

0.014661 

0.6 

0.604393 

0.006919 

0.980009 

0.021174 

0,7 

0.695617 

0.004870 

0.984986 

0.020208 

0.8 

0.777597 

0.004416 

1.008638 

0.019917 

0.9 

0.857607 

0.003533 

1.076121 

0.030506 

Compare  the 

above  with  the 

simulations  performed  by  McClave  (1974)  for 

the  cases  0 

*0.5  and  0.9. 

See  also 

Godolphin  and  de 

Gooijer  (1982)  . 
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The  new  method  we  want  to  propose  has  the  following  theoretical 


backing.  Let  X  =  (X^  ,X2, . . .  be  a  random  vector  normally  distributed 


with  mean  vector  0  and  dispersion  matrix  A^.  Let  Z  =  (Z^,Z2, . . . .Z^) 


be  a  random  vector  normally  distributed  with  mean  vector  0  and  dispersion 


matrix  given  by 


The  random  variables  Z^ ,Z2, . . . .Z^j  are  independently  normally  distributed 
with  Z2,Z2» . . .  being  degenerate,  all  with  common  mean  zero  and  the 


variance  of  each  of  Zj^  and  Z^^  being  equal  to  Assume  that  X  and 


Z  are  independent.  It  then  follows  that  Y  =  X  +  Z,  where  =  indicates 


equality  in  distribution.  If  we  have  a  realization  z  of  Z,  then  we  could 


obtain  a  realization  x  of  X  using  y  (given  data)  and  z  by  taking 


X  =  y  -  z.  Then  we  can  work  with  the  exact  likelihood  of  x  for  estimating 


6  and  a  instead  of  working  with  the  approximate  likelihood  of  y  for 


the  estimation  of  6  and  ,  One  way  of  obtaining  a  realization  of  Z 


is  by  simulating  Z  once.  The  simulation  of  and  Z^  involves  the 


unknown  parameters  B  and  a  .  We  can  use  some  decent  estimates  of 


and  a  to  simulate  Z,  and  Z.,.  This  is  the  basic  idea  behind  the  new 

i  N 


method.  Schematically,  we  outline  the  procedure  as  follows. 


Step  1.  Estimate  3  and  a  using  the  approximate  likelihood  of 

A  A  2 

y^j.  Let  and  be  the  respective  estimates. 

Step  2.  Simulate  and  each  once,  where  and  Z^^  are  Independently 


identically  normally  distributed  with  mean  0  and  variance 
Let  the  realizations  be  denoted  by  and  z^. 


■'Z  ^2 


Step  3.  Define  x^  =  y^ 


for  i  ■=  2,3 , . . .  ,N-1 , 


=  y.  -  z.  for  i  =  1,N. 
i  1 


T  T 

Step  l*.View  x  =  (x^^  ,X2» . . .  ,x^)  as  a  realization  of  X  =  (X^,X2 . • 

2 

a  using  the  likelihood  of  x.  Let  these  estimates 


Estimate  6  and 

A 

be  denoted  by  6 


(2)  °(2)* 


A  A  2 

Keep  repeating  Steps  2  and  3  until  two  consecutive  B's  and  a  ’s 
agree  in  a  specified  number  of  decimal  places. 


Some  of  the  theoretical  properties  of  these  estimators  are  currently 
under  investigation  by  the  authors. 


3.  Simulation  Studies 

We  simulated  a  moving  average  model  of  order  one  with  S  =  0.1  (0.1) 
2 

0.9  and  a  =  1  taking  N  =  100,  and  used  the  above  procedure  to  get 
"  “2  2 

estimates  6  and  o  of  6  and  a  ,  respectively.  This  is  repeated  100 
times.  The  following  table  gives  the  averages  and  variances  of  these  estimates 


over  100  repetitions 


Table  2  :  Mean  and  variances  of  the  estimates  obtained  by  using  a  combinat 
of  approximate  likelihood  and  simulation  of  two  dummy  variables 


True  value 

of  0 

3 

var(6) 

-1 

a 

• 

var(a  ) 

0.1 

0.0934 

0.0139 

0.9935 

0.0227 

0.2 

0.1908 

0.0084 

0.9916 

0.0191 

0.3 

0.3016 

0.0076 

1.0216 

0.0226 

0.4 

0.0098 

1.0096 

0.0130 

0.5 

0.0085 

0.9916 

0.0183 

0.6 

0.6044 

0.0081 

1.0013 

0.0201 

0.7 

0.6928 

0.0072 

1.0204 

0.0271 

0.8 

0.7706 

0.0042 

1.0182 

0.0203 

0.9 

0.8589 

0.0034 

1.0499 

The  computer  program  for  the  above  is  available  from  the  authors 
on  request. 

McClave  (1974)  recommends  Parzen-Clevenson's  method  for  estimatini 


3  with  samples  of  moderate  size.  His  simulation  studies  cover  £  =0.5  anr' 
0.9  only.  The  following  table  gives  his  results  (with  the  best  in  each 
category)  along  with  the  ones  obtained  above. 


Iwi 

1$ 


Method 


True  value  of  S 


0.5 

Mean  Variance 


0.9 _ 

Mean  Variance 


Durbin's 


0.4991 


0.0104 


0.8713  0.0076 


Walker ' s 


0.4920 


0.0072 


0.8414  0.0051 


Hannan ' s 


0.5025 


0.0072 


0.8540  0.0055 


Parzen-Cl evenson ' s  0.4912 


0.0070 


0.8404  0.0051 


4rderson '  s 


0.4997 


0.0075 


0.8324  0.0038 


Approximate  likelihood 

0.5023 


0.0096 


0.8576  0.0035 


Chapeh-Rao's 


0.5012 


0.0085 


0.8589  0.0034 


Note  :  In  the  first  five  methods,  the  averages  were  taken  over  200  repetitions 
In  the  last  two  methods,  the  averages  were  taken  over  100  repetitions. 


In  conclusion,  we  remark  that  the  execution  of  the  new  method 


is  direct  and  simpler  than  the  five  methods  examined  by  McClave  (1974). 


There  seems  to  be  some  improvement  in  the  accuracy  of  the  estimates 


obtained  by  using  the  new  method  than  by  using  approximate  likelihood 


especially  in  the  lower  reaches  of  S, 


, 


I 
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5.  COMPUTER  PROGRAM 

Language 

FORTRAN  77 

Description  and  purpose 

Estimate  the  parameters  of  a  moving  average  model  of  order  one  using 
a  combination  of  approximate  likelihood  ^nd  simulation  of  two  independent  normal i 
random  variables  a 

Structure 

SUBROUTINE  G05DDF (XM, SIGl)  :  gives  a  random  sample  from  a  normal  distribution 
with  mean  XM  and  variance  SIGl. 


Formal  parameters 


XM  INTEGER  INPUT  ;  ZERO 

SIGl  REAL  INPUT  :  ONE 


SUBROUTINE  CO5NBF(FUN,2,X,F,TOL,W,20,IFAIL) 


Formal  parameters 

X  Real  array  of  dimension  2  Input  :  Initial  guesses  of  parameters 

Output  :  gives  estimates  of  the  parameters 


TOL  The  accuracy 

W  The  work  space 

IFAIL  INTEGER  Output  :  a  fault  indicator  equal  to 


IFAIL  -  1 

IFAIL  -  2 

IFAIL  =  3 

IFAIL  -  4 


On  entry,  N  _<  0,  or  XTOL  <  0.0,  or  LWA  '-<n(3NH 
There  have  been  atleast  200(N+1)  evaluations. 
No  further  improvement  In  the  solution  is  possi 
The  iteration  is  not  making  good  progress. 


AUXILIARY  ALGORITHM 

C05NBF  uses  the  subroutine  FL'N(L,X.F, IFAIL)  :  it  finds  the  zeros  of  two  non- 

2 

linear  equations  F(l)  and  F(2)  in  the  unknown  parameters  £  and  a  . 


N  *  the  total  sample  size 


Estimation  of  parameters  of  a  moving  average  model  of  order  one 
IMPLICIT  REAL *8  (A-H,0-Z) 

IMPLICIT  INTEGER*2  (I-N) 

DIMENSION  XV(N=),  S(N=),  X(2),  W(30),  F(2),  YV(N=),  U(2),  T(N=) 

COMMON  3,N 

EXTERNAL  FUN 

IFAIL  -  0 

XI  =  O.ODO 

X2  =  O.ODO 

XM  =  O.ODO 

TOL  =  DSQRT(X02AAF (O.ODO)) 
open(5,  file  =  'data') 

OPEN (6,  FILE  =  'RESULTS') 
read (5,*)  XV 
WRITE(6,201) 

N  = 

DO  4  J  =  1,N 

S(J)  =  0,0 
DO  5  I  =  1,N 

L  =  N-I+l 
DO  5  K  =  1,L 

J  =  K+I-1 

S(I)  =  S(I)+XV(K)*XV(J) 

X(l)  =  lD-1 
X(2)  =  l.ODO 

CALL  CO5NBF(FUN,2,X,F,TOL,W,20,IFAIL) 

IF(ABS(X(l)-Xl).LT.0.1D-2.AND.ABS(X(2)-X2).LT.0.1D-2)  GO  TO  90 
XI  -  X(l) 

X2  *  X(2) 

SIGl  *  X1*X1*X2 
DO  6  1-1,2 

Simulation  of  two  independent  random  variables 
U(I)  -  G05DDF(XM,SIG1) 

CONTINUE 


YV(1)  »  XV(1)-U(1) 

YV(N)  -  XV(N)-U(2) 

DO  7  1-2, N-1 

YV(I)  -  XV(1) 

CONTINUE 
DO  9  J  -  l.N 
T(J)-0.0 
DO  10  I-1,N 

L-N-I+1 
DO  10  K=1,L 

J-K+I-1 

T(I)-T(I)+YV(K) *YV(J) 

X(1)-1D-1 

X(2)-1.0D0 

CALL  C05NBF (FUN , 2 ,X,F,T0L, W, 20, IFAIL) 

IF(ABS(X(l)-Xl).LT.0.1D-2.AND,ABS(X(2)-X2).LT.0.1D-2)  GO  TO  90 
Xl-X(l) 

X2-X(2) 

GO  TO  100 

WRITE(6,202)  XI, X2 
FORMAT (' r ) 

FORMAT ('OF INAL  RESULTS  ARE  BHAT',  F10.6,  'SIG.SQ' ,F10.6) 

STOP 

END 

SUBROUTINE  FUN (L,X,F, IFAIL) 

IMPLICIT  REAL*8  (A-H,0-Z) 

IMPLICIT  INTEGER*2  (I-N) 

DIMENSION  F(2) ,S(N=),X(2) 

COMMON  S,N 

F(l)  =  -N*X(2)*(1.0D0-X(1)*X(1))+S(1) 

F(2)  =  X(1)*X(2)*(1.0D0-X(1)*X(1))-X(1)*S(1) 

DO  1  1-2, N 

F(l)  -  F(1)+2.0D0*(-1.0D0)**(I+1)*(X(1)**(I-1))*S(I) 

F(2)  -  F(2)+((-l,0D0)**I)*(X(l)**(I-2))*(I-l+(3-I)*X(l)*X(l))*S(I) 
CONTINUE 
RETURN 
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Approximate  Likelihood,  Exact  likelihood.  Moving  average  model.  Simulation. 


20  AB^IRACT  (C<$ttHnum  on  fovoroo  «<do  If  nocoaoory  mnti  lamnttly  Or  block  numbor) 

The  exact  likelihood  of  the  data  coming  from  a  moving  average  model  of 
order  is  complicated.  In  this  paper,  we  propose  a  method  of  estimation  of 
the  parameters  of  a  moving  average  model  of  order  one  based  on  the  approximate 
likelihood  of  the  data  on  the  simulation  of  a  pair  of  random  variables.  Some 
comparisons  were  made  of  this  method  with  some  well  known  methods  for  moderate 
sample  sizes.  A  comuter  program  is  appended  which  is  helpful  in  using  this 
method. 
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